Signal-Detection Studies, with 
Applications 

By E. L. KAPLAN 

(Manuscript received October 10, 1954) 

Curves are given relating the ■probability j3 of detection of a signal in noise 
to the signal-to-noise 'power -ratio S/N, to the proportion a of false detections 
that can he tolerated, and to the time available {more specifically, to ike 
number m of independent squared samples of the envelope of the filter output 
that are averaged in making a single attempt at detection). For the curves, 
three types of sinusoidal signals are assumed, according as the amplitude is 
constant, varies at random very slowly (fading), or varies as rapidly as the 
filtered noise itself. The second case is of course very unfavorable for reliable 
detection, and the third is also if one is limited to one or two sample points. 
The curves are applied to problems of optimizing radar parameters such as 
pulse energy, scan rate, averaging time, etc. 

The Appendix gives the mathematical background for the foregoing and 
then proceeds to consider additional types of signal (do and arbitrary 
Gaussian) and methods of detection {failure to rectify or take the envelope, 
countitig of samples above a threshold, and averaging by continuous integra- 
tion) . 

1. INTBODUCTION 

The word detection suggests a decision between just two alternatives : 
either a signal was transmitted, or it was not. Typically, however, such 
decisions are made repeatedly at short intervals of time, with the effect 
that a multiplicity of possibilities are involved, namely the time intei'vals 
in which signals are received, and perhaps also the carrier frequencies at 
which they are transmitted. In radar and sonar systems, rotating direc- 
tional receivers map one, two, or three dimensions of space upon the 
time axis, so that the observation of time is translatable into an observa- 
tion of position. In these applications, of course, the received signal is a 
reflection of one transmitted by the observer, and the aircraft or other 
object to be detected is not attempting to communicate with the ob- 

403 



40-t THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1955 

server. Telegraphy and PCM are applications in which the signals do 
represent attempts to commuuicate. In all cases, random noise is present, 
and will hide signals whose intensity is sufficiently low. 

If the bandwidth of the noise accompanying the signal is considerably 
larger than that of the signal, the best practical procedure is well known 
to be to pass the signal-plus-noise through a bandpass filter whose band- 
width approximates the larger of the followmg: (a) The bandwidth of 
the signal, (b) The reciprocal of the time available for detecting the 
signal.^ If the frequency of the signal is not knowai in advance, one of 
course moves the pass-band of the filter up and down the frequency scale 
and thus searches for the signal in frequency as well as in time; the pres- 
ent discussion applies equally well to this case. 

In this way much of the noise may be eliminated, but that is not the 
end of the problem. Some noise still gets through. However, the presence 
of a signal may be expected to produce an increase in the magnitude of 
the rectified output. The purpose of this discussion is to indicate how 
great this increase should be required to be before one decides a signal is 
present, to draw conclusions therefrom regarding optimum procedures, 
and to illustrate the great importance of the nature of the signal and the 
method of detection. For simphcity, square-law rectification is assumed; 
it is known that luiear rectification does not give very different results.^ 
The noise, and in some cases the signal also, is assumed to be Gaussian. 

We assume the followmg detection procedure, which may apply liter- 
ally or else be approximately equivalent to that used in a physical system 
(e.g., averaging by continuous integration, as in Section 15; or by a 
human observer, or a phosphor). The rectified output is sampled at m 
different instants of time,^ which are far enough apart so that the values 
of the noise are effectively independent (uncorrelated) . If the average 
output at these m instants exceeds the average noise level A'' by an 
amount kN or more, we decide that a signal is present; if not, we decide 
no signal is present. For simphcity, the value of A^ is assumed to be 
known as the result of past observation; smce this is only approximately 
true in practice, the results will somewhat exaggerate the effectiveness 
of the detection procedure, especially for large values of m and low signal 
strengths. Another assumption made in calculating the curves is that if 

1 Alternative (b) is superfluous if, in determining the bandwidth, the signal is 
defined to be zero outside the time interval within which it is available for analy- 
sis. 

*M. Schwartz in his Harvard (1951) dissertation, "A Statistical Approach to 
the Automatic Search Problem," finds agreement to within 0.2 db. 

3 This assumes a narrow-baud output whose envelope is sampled; if no en- 
velope is obtained, the number of samples is denoted by 2m. The point will be dis- 
cussed below. 
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a signal is present at all, it is present at each of the 7Ji instants sampled; 
the methods for removing this assumption are discussed later. 

It is well known (and shown in Section 5) that the averaging after rec- 
tification described above does not fully compensate for a filter whose 
passband is too wide; but when the filter has been made as selective as it 
can or should be, the post- rectification averaging, when it is possible, 
gives a further increase in sensitivity. 

In practice many of these averages must be formed, and many deci- 
sions made, corresponding to the search for the signal in time and 
possibly also in frequency and in geometrical position (e.g., radar detec- 
tion of an airplane). The probability {for any one average or any one 
decision) of deciding that a signal is present is denoted by /3 or a accord- 
ing as the signal is actually present or not. Thus a is the proportion of 
false alarms among the total number of averages containing no signal, 
while /3 is the proportion of valid detections among all those averages 
that do contahi the signal. A detection is considered vahd only if it is 
associated with the average, or one of the averages, in which the signal 
actually occurs. The average time between decisions divided by a gives 
the average time between false alarms (in case the signal is usually 
absent) . 

The problem could now be formulated thus: to calculate the values of 
k and ^ corresponding to given values of m, a, and the signal-to-noise 
power-ratio S/N. Actually it has been convenient to regard m and S/N 
as the principal variables, and so to plot their relationship for a few 
different values of ^ and a. The number k depends only on m and a, and 
is numerically equal to the S/N values {7ioi measured in db) given by the 
curves for /3 = 0.50 in Fig. 1. (These curves should be rigorously correct 
fo)- k, whereas their use for S/N involves an approximation as discussed 
below.) 

2. THE THREE TYPES OF SIGNAL AND EXPLANATION OF THE GRAPHS 

Three kinds of signal are considered: (1) Steady sinusoid. (2) Fading 
sinusoid. (3) Noise-hke signal. All of these are in a sense special cases, 
but other signals will generally be of some type intermediate to these. 

Cases 1 and 2 are alike in that for both it is assumed that the m signal 
amplitudes occurring in an average are identical, whereas in Case 3 these 
m amplitudes are assumed to be independent random variables, just as 
the corresponding noise values are. 

Cases 1 and 2 differ in that in Case 1 the signal-to-noise ratio S/N 
refers to the instantaneous signal power received, while in Case 2, S/N 
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Fig. 1 — Signal-to-noise ratio required for detection of steady sinusoidal sif 
nal. 



refers to a long-term average of the signal power, which may be either 
greater or less than the instantaneous power. Thus the signal amplitude 
in Case 2 is a random variable, but one that does not change much during 
the period of time that is averaged over. The Rayleigh or circular Gaus- 
sian distribution has been assumed for the signal amplitude, correspond- 
ing to a Gaussian signal. For the signal power, this becomes the exponen- 
tial distribution. 

The pulses of carrier used in communication, and possibly the radar 
return from a fixed object, can be considered as steady sinusoids (Case 1). 
The radar return from an airplane belongs to Cases 2 or 3 or intermediate 
cases, since the phase relations of the returns from different parts of the 
airplane change by different amounts as the aspect of the airplane 
changes. Case 2 may arise in at least three ways: 

(a) The signal as generated may be Gaussian and have a very narrow 
but non-zero bandwidth; i.e., its Nyquist interval may be as large as, or 
larger than, the averaging time employed. 

(b) The signal may consist of several sinusoids of slightly different 
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frequencies beating against one another. If there are reflecting surfaces 
involved and the source of the signal, the observer, and the reflecting 
surfaces have any relative motion, the same phenomenon of beats occurs 
even with a single sinusoid, whenever multiple paths for its transmission 
exist. Interference between radar reflections from an airplane and from 
its image in the sea surface is a familiar example. 

(c) Even if the signal in each instance is a steady sinusoid, one may 
still have to regard the collection of ampUtudes encountered on different 
occasions as values of a random variable. Thus, since various airplanes 
have different speeds and radar cross-sections and are detected at differ- 
ent ranges, the strengths of their radar returns will differ accordingly. 
Another example is provided by the interference between direct and 
reflected signals in the absence of any relative motion among the signal 




rt = PROPORTION OF FALSE DETECTIONS 
WHEN SIGNAL IS ABSENT 

A = PROPORTION OF VALID DETECTIONS 
WHEN SIGNAL IS PRESENT 



200 



2 4 6 8 10 20 40 60 80 100 

m = NUMBER OF INDEPENDENT NOISE VALUES AVERAGED 
-HALF THE NUMBER OF DEGREES OF FREEDOM 



Fig, 2 — Signal-to-noise ratio required for detection of a fading sinusoidal sig- 
nal (amplitude steady during each detection, but variable from one detection to 
another). 
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source, the observer, and the reflecting surface. Then the signal strength 
may be constant with time, but it will still be a random variable depend- 
ing on the positions that the source and the observer happen to occupy. 

The exponential distribution of signal power assumed in the present 
treatment of Case 2 is theoretically exact for situation (a) above, and 
possibly as good as one can do for situation (b). In situation (c) the proper 
distribution may be ((uite different, though its effect should be qualita- 
tively similar. 

In all cases the S/N value is defined as if the signal were continuously 
present; i.e., it does not depend on the duration of the signal. In Case 1, 
S is the peak signal power, while in Case 2 it is the average of the various 
possible peak signal powers. In Case 3, S might be described as the peak 
value of the statistical expectation of the power. 

Curves of S/N versus m are given for the three cases in Figs. 1 to 3 
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Fig. 3 — Signal-to-noise ratio required for detection of a noise-like signal. 
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ri[5. 4 — ■ Comparison of the signal-to-noise ratios required for detecting various 
kinds of signals. 

respectively, for a = 10"^ (dotted lines) and ]0~^ (solid lines) and three 
values of 0. In Fig. 4 one curve from each of the other figures is repro- 
duced for comparison, and also one new curve (the broken Une) to be 
discussed in Section 6. Curves for (3 = 90 per cent may be interpolated 
ill Figure 1 (and in Fig. 3 when m ^ 10) at about 0.58 of the distance 
fi-om the curve for (3 = 50 per cent toward the curve for j3 = 99 per cent. 
This may be done by eye, or nimerically with S/N expi'ossed in decibels. 
The curves for /3 = 1 per cent on Figure 1 are probably of low accuracy. 

These same throe cases are also considered (for somewhat different 
values of the parameters) by M. Schwartz in his dissertation cited previ- 
ously, and by J. I. Marcum and P. Swerlhig in their work at the Hand 
Corporation. 

The curve in the lower left corner of Fig. 1 shows the relation 

S/N = 2'"" - 1 
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that would exist between S/N and m if the maximum information-carry- 
ing capacity of the system were utilized. The maximum capacity is 
(l/2m) bit per Nyquist interval (l/2ir; see next Section), achieved by 
having the signal present with an independent probability of 1/2 in each 
average of m samples. According to C. E. Shannon's theorem,^ the maxi- 
mum capacity in terms of S/N is log2(l + S/Ny^ bits per Nyquist inter- 
val. When m is large (or equivalently, S/N' small), the relation is S/N 
= (\oge2)/m. 

3. details: DC SIGNALS, ENVELOPES, ETC. 

This section discusses various other cases of less importance than the 
three defined in the preceding section; namely, dc signals, low-pass and 
broadband filters, the relations between instantaneous values and the 
envelope, and the distinction between narrow-band noise and a noise- 
modulated carrier. The first three topics are intimately connected; just 
as sinusoidal (ac) signals, narrow-band filters, and envelopes naturally 
go together (Sections 1 and 2), so are dc signals, low-pass filters, and 
instantaneous samples usually associated. 

The optimum detection of a dc signal, given independent samples, is 
trivially easy. No filter is needed, and rectification is undesirable, as 
shown by the two lowest curves on Fig. 4. The lowest curve, labelled 
"steady dc," is obtained by the optimum procedure of taking the simple 
average of the unrectified sample values, some of which may be negative. 
If the squared values are averaged, the curve will coincide with the next 
higher curve, labelled "steady sinusoid," as shown later in connection 
with equations (13b) and (13c). The "fading dc" signal is one which is 
constant during each detection but has a Gaussian distribution of mean 
zero from detection to detection. Although it is the worst curve on the 
figure, quadratic averaging would make it still poorer. [On the other 
hand, (12e) shows that rectification is as indispensable for the detection 
of a lowpass noise-like signal as for any other rapidly oscillating signal.] 
Both of the dc curves are straight lines of 45° inclination, and for them 
the number of samples is not m but 2m. This adjustment keeps the total 
time the same, and in the case of quadratic averaging produces complete 
equivalence between the dc and the sinusoidal signal, as shown in Section 
13. The simple formulas applying to the averaging of unrectified dc 
signals are given later as equations (12a) to (12c). 

If a filter is used in detecting a dc signal, it must be of the low-pass 

^B.S.T.J., 27, pp. 379-423, 623-656, 1948. Proc. Inst. Radio Eng. 37, pp. 10- 
21 , 1949. Mathematical Theory of Communication (with Warren Weaver) . 
Univ. Illinois Press, 1949. 
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type,^ and its effect is not essentially different from that of the assumed 
averaging of m sample values. In detecting an ac signal, a narrow-band 
filter is decidedly preferable to a low pass because it eliminates more 
noise; but it also has the effect of permitting the (squared) envelope of 
the filter output to bo obtained, provided the frequencies contained in 
this output are confined to a range of less than 3 to 1. In this case the 
output of the square-law rectifier will contain two separate bands of 
frequencies of equal widths which (given a reasonable separation between 
them) can be separated by another filtration. The lower frequency-band 
is usually the only one that is wanted, and it gives half the square of the 
envelope of the output of the first filter. If the frequency range of the 
first filter output is 3 to 1 or more, the envelope is still susceptible of a 
theoretical definition but it cannot be isolated so easily and is then a 
somewhat artificial concept. 

The general effect of a second filtration after rectification of an ac sig- 
nal, whether or not the envelope is actually obtained, is to increase the 
reliability of a single sample, without necessarily having a marked effect 
on an average over a long (fixed) period of time. The elimination of the 
sinusoidal component resulting from the signal, and having double its 
original frequency, is perhaps the main object. If this is not done, it will 
be necessary to do considerable averaging to eliminate the possibifity of 
missing the signal because of sampling it at its troughs. In this respect 
instantaneous sampling of a sinusoidal signal is qualitatively sunilar to 
the various cases of the sampling of the noise-like signal. 

The properties of the envelope will now be considered. Let ni{t) and 
Uiit) be Gaussian noises containing no radian frequency above oj/2. 
Then the spectrum of 

n(t) = ni(i) cos nt + ^2(0 sin m (3a) 

is limited to the interval Si - a)/2, fl -^ w/2. Conversely, consideration 
of the Fourier transform of 'ii(t) shows^ that any (stationary) noise whose 
spectrum is limited to S2 ± w/2 can be expressed in the form (3a). It is 
found furthermore that 

En,{t)niiu) = En2{t)n,(u) = [ P(X) cos (X - n)(t - u) d\ (3b) 

JO 

Eniit)n,(u) = -Eni{u)n2(t) = [ P{\) sin (X - n){t - u) d\ 

Jo 

5 Thia may not be tvue in a rigorous sense. If indefinitely prolongeddc signals 
are not encountered, a cut-off at a eufficientiv low frequency is permissible, 

6 For example, see S. O. Rice, B.fi.T.J., 24, pp. 46-156, 1945, Section 3.7. 
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where P(X) is the power per radian/sec. for frequencies in n(t) whose 
absolute values are in the neighborhood of X radians/sec. Let ^poit — u) 
and Tpi{t — u) represent the two distinct covariances of {3b), the sub- 
scripts and 1 reflecting the even and the odd characters of the two func- 
tions. Then 

En{t)n{u) = }f/o(t — ii) cos n{t — u) — ^i{t — u) sin ^{t — u) (3c) 
Replacing S2 in (3a) by S2o + ^i gives 
n{t) = [ni(t) cos Uit -\- n2{t) sin SJii] cos S2o^ 

+ [—ni{t) sin S2ii + 712(0 cos S2ii] sin fio* 
so that the same envelope 



is obtained regardless of the value adopted for the "carrier" frequency. 
However, the highest frequency occurring in n\{i) and n^it) will be mini- 
mized by taking fi in the center of band; and (3b) shows that if the power 
spectrum of n{t) has a center of symmetry which is taken as fi, then 
Eni(t)n2(u) = 0. 

The noise-hke signal used in this study, like the filtered noise itself, 
has the form (3a). The curves do not apply quantitatively to a single 
term ni(t) cos Qt obtained by modulating the carrier cos 12/ with a low- 
frequency Gaussian noise-like signal ni{t), though the necessary tools 
are given in equations (13g) and (13h) and the remarks following there- 
after. 

The most obvious difference between the two signals resides in their 
envelopes, which are 

Vnm + nl(t) 

(with a Rayleigh distribution) and [ ni(t) \ (the absolute value of a 
Gaussian variable) respectively, but other differences may be discovered. 
The former can be, and is assumed to be, stationary, Gaussian, and 
ergodic. The latter is stationary only if the phase <p of the carrier cos 
(Qt + (p) is taken to be random, but the relative phases of the sinusoidal 
components of niit) cos (S2i + <p) are still not completely random, and 
the signal is neither Gaussian nor ergodic. [The Gaussian variable ni(t) 
is multipled by cos (Q,t + <p), which has the distribution dz/wy/l — z".] 
Where detection is concerned, the two cases are qualitatively similar, 
but the single term 7ii(t) cos Ut has a greater amount of fluctuation for 
the same amount of power, and is therefore a little harder to detect than 
the sum of the two terms. 
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The results of this study have been phrased in terms of the narrow- 
baud two-term form Hi{/) cos Ut + 712(1) sin Ut for the noise and the noise- 
like signal. However, the curves apply also to the less important case of 
the detection of a dc signal by I'ectification (which is not the optimal 
procedure, as shown above). The word "sinusoid" is to be replaced by 
"dc signal," and two independent samples of the rectifier output are to 
be taken for every one that is prescribed in the narrow-band case. From 
a noise or signal that (at the input to the square-law rectifier) has a flat 
spectrum of width W cps, independent samples are obtainable at inter- 
val l/W seconds in the narrow-band case, and at interval 1/2W in the 
lowpass (dc) ease,^ so that for large m the averaging time is in/W seconds 
in both cases. The amplitude of the "fading" signal of Case 2 with its 
Rayleigh distribution is equivalent in the lowpass case to the RMS 
vahie formed from two independent samples of a Gaussian noise-like 
signal. The case of only one sample could be calculated but would give 
even less satisfactory detection. 

4. NUMERICAL EXAMPLES (UADAIl) 

The following hypothetical example illustrates the concepts involved. 
Suppose one has a radar that searches in range and azimuth with a beam 
3° wide, a pulse rate of 5,000 per second, a pulse length of 1 microsecond, 
and a scan rate of 10 per minute. On the average one false detection in 
15 minutes can be tolerated. Pulses returned by a target during a single 
scan are averaged (after rectification). What signal-to-noise ratio is 
required to give a probability of 90 per cent of detection in one scan? 

This is the narrow-band case. The pulse length is usually about equal 
to the reciprocal of the bandwidth and so can be taken as the sampling 
interval. 200 samples of the radar return could then be taken in the 0.0002 
sec. elapsing between consecutive transmitted pulses. Suppose that 150 
of these are relevant, giving 150 values of range that can be distinguished. 
Similarly the azimuth scan of 300° is covered by 120 beam-widths (this 
does not assume that the azimuth accuracy is no better than 3°). If a 
factor of 2 is allowed for overlap (in range or azimuth or both) among the 
averages, the number of decisions per scan is 2 X 120 X 150 ^ 36,000, 
or 5,400,000 in a period of 15 minutes. So a = 1/5, 400,000 - 2 X 10"'. 
In each s(;an the beam is on a target for 0.05 sec, the time required to 
turn 3°. In this time 250 pulses are transmitted; this is the value of m, 

'The latter interval is well-known; the former is twice aa long because the 
smoothing accompanying rectification in the narrow-band case makes the sam- 
pling equivalent to the sampling of niil) and ni{l), and their bandwidth is not W 
but only 1172. 
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since returns from different ranges and/or azimuths are averaged 
separately (e.g., by a PPI scope). The 250 samples in an average are 
thus not consecutive in time in this case. 

The vahies of S/N can be read just above the curves for a ^ 10~ 
(which are the solid curves). For a non-fading return, Fig. 3 then gives 
S/N equal to -4.2 db for = 50 per cent and -2.2 db for /3 - 99 per 
cent ; by interpolation, S/N is about — 3 db for /3 = 90 per cent. It should 
be remembered that S is the peak (not the average) signal power. For a 
fading return, Fig. 2 gives S/N equal to 5.5 db. Use of the latter figure 
would imply that the returned pulses had virtually the same amplitude 
during the time of 0.05 sec. during each scan when the beam was on the 
target (but still had a random amplitude w'hen viewed for a sufficiently 
longer period). On the other hand, use of S/N equal to — 3 db would 
imply that the values of the signal at interval 0.0002 sec. were virtually 
independent samples. These conditions may also be expressed in terms 
of the width of the lines or narrow bands, if any, in the spectrum of the 
signal (the spacing between the lines is the pulse repetition rate of 5000 
cps, which is irrelevant here). If the width is 5000 cps or more (i.e., the 
spectrum continuous), one has S/N equal to —3 db; if the width is 20 
cps or less, one has S/N equal to 5.5 db. The intermediate region is 
rather extensive, corresponding to a factor of m = 250. It might be 
explored iu an approximate manner by the formulas (13g) and (13k), 

If the line-width is not much more than 20 cps, but not less than say 
1 cps, then conclusion (A) of Section 8 shows that the probability of 
detecting the airplane within 6 seconds ( = 1 scan, as first stated) is 
increased by increasing the scan rate to as much as 1 per second, so that 
a number of scans are completed within the 6 seconds. 

Suppose now that one has a radar receiver with an antenna pattern 3° 
wide scanning in azimuth at 10 rps as before, whose object is to detect a 
distant radar C-W transmitter whose frequency is only known to lie 
within a band 150-mc wide. The detection is accomplished by passing 
the signal through a filtering device that passes 150 different frequency 
bands of 1 mc each in succession (one at a time). The problem is then 
numerically the same as before, the search in frequency having replaced 
the search in range. There is the difference that here the samples in any 
average are presumably all consecutive in time, while previously they 
were taken at intervals of 0.0002 sec, the time betw^een transmitted 
pulses. The search in frequency also occurs in the determination of the 
velocity of an airplane by its Doppler frequency, but the bandwidth of 
the frequency-analyzer is then much less than 1 megacycle, and not 
nearly so many independent samples can be obtained. 
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If the signal is applied simultaneously to a bank of filters (e.g., vibrat- 
ing reeds), the number of decisions is the same as before, but the saving 
of time would permit a corresponding increase in the number m of sam- 
ples in an average. 

B. McMillan has pointed out that with long-range search radars whose 
resolution is much better in range than in the other coordinates, some of 
the range resolution might profitably be sacrificed in order to increase 
the pulse length. Although the longer pulse length could be used to in- 
crease the value of m, it would be preferable to decrease the receiver 
bandwidth instead, and thus decrease the noise power N in the same 
ratio. 

Conclusions 
5. three major effects 

The curves show that the steady sinusoid is the easiest signal to 
detect, as one would expect, W'hile the fading sinusoid is the most difficult 
to detect reliably. It is therefore very desirable to avoid the latter situa- 
tion if reliable detection is wanted, either by reducing the severity of 
the fading and so moving toward Case 1, or by sampling the output over 
a period of time long enough to average out some of the fluctuation in the 
signal amplitude, and so moving toward Ca.se 3 (noise-like signal). The 
latter is of intermediate difficulty of detection, and coincides with Case 
2 when m = I and approaches coincidence with Case 1 as m -^ =^ . The 
difficulty with the fading sinusoid is this: If the average signal power 
is equal to that which gives good detection in Case 1, little reliability is 
left to be gained in those detections where additional signal power hap- 
pens to be available, but much may be lost when the signal power hap- 
pens to be lower than the average. 

A second major conclusion results from the steepness of the left-hand 
portion of the curves for /3 = 99 per cent in Fig. 3: If reliable detection 
of a noise-like signal is required, it is highly desirable that at least 4 or 5 
independent samples of the signal be available and made use of. In fact, 
if a 99 per cent chance of detection is desired, 4 samples require only 
1.^0 of the signal power, or if 2 of the energy required by one sample. 
The principle is well-known in connection with search radars, which are 
designed to return about four pulses from a target. 

When m is significantly greater than unity, and the samples being 
averaged are adjacent to one another in time, one has the option of using 
a more selective filter and thus doing the averaging linearly (with preser- 
vation of signs) before rectification rather than after. The former is well- 
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known to be the more effective in Cases 1 and 2. (Case 3, on the con- 
trary, represents the situation that results when the selectivity of the 
filter has ah-eady been made as great as it can profitably be.) Let the time 
available for the detection be fixed. Then m, the number of independent 
noise samples available, is proportional to the filter bandwidth; the latter 
is inversely proportional to S/N, provided the noise spectrum can be 
regarded as flat in the region considered, and the filter does not reject 
any of the signal frequencies. Thus m and S/N are inversely proportional, 
and one is operating along a 45° line in Figures 1 and 2 (both m and S/N 
being plotted logarithmically). Evidently /3 is maximized by keeping m 
(and hence the bandwidth) small. 

6. MATCHING THE DURATIONS OF SAMPLE AND SIGNAL 

It is fairly obvious intuitively that the chance of detection would be 
greatest if some one average coincided exactly with the period during 
which the signal was present. (The signal may be intermittent, as with 
the first radar of Section 4; if so, the sampling also should be intermittent 
in the same pattern.) There is no way to insure this if the duration of the 
signal is not known in advance, but if it is known, the desired coincidence 
could be approximated to some extent by having the averages overlap; 
e.g., run from to 1 time unit, 3-^ to Ij^, 1 to 2, 1^ to 2}4, etc. This 
increase in n necessitates use of a smaller value of a and hence requires 
an increase in signal strengt,h, but the latter increase is insignificant: 
When /3 ^ 0,50, the curves show that it is 0.3 db or less for a factor of 
2 in a. Similarly, the passbands may overlap when one searches in fre- 
quency, and the radar antenna patterns may overlap when one searches 
in direction. 

If the averages include fewer samples (though all the samples in some 
avei'age (contain the signal), the effect in any of the Figs. 1 to 4 is to move 
to the left along a horizontal line. The detection probability is decreased 
because there is no increase in the concentration of the signal energy, 
while the fluct\iation of the noise is averaged out less effectively. 

If the averages include too many samples, then some of these samples 
will always consist of pure noi.se, even when a signal is present, and the 
concentration of the signal energy is reduced relative to that of the noise. 
If a number ?»' of samples containing the signal are increased to m. by 
adding m, — m' samples of pure noise, the effect in Figs. 1 and2 is to move 
down and to the right along a 45° line, since the signal-to-noise ratio is 
effectively reduced by the same factor m/m' by which the number of 
samples is increased. Evidently this decreases &. 
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For the noise-like signal of Fig. 3, new calculations are required when 
m' < m, and the brolcen line in Fig. 4 shows some results obtained by the 
chi-square approximation of equation (13g), with m" = m'. This curve 
is plotted agamst m (assumed for this example to be twice m') and so 
shows the effect of halving the duration of the signal. To show the effect 
of adding an equal number of pure noise samples (the duration of the 
signal being kept fixed), the curve should be plotted against m', which is 
equivalent to moving the curve to the left a distance corresponding to a 
factor of 2. The resulting curve still lies above the solid curve (for which 
m = m') for a noise-like signal, but only by about 1 db, which is about 
the same loss that one finds in Figs. 1 and 2. 

It is natural to ask which one should guard against the more, taking 
too many samples or too few? The penalty for the former increases rather 
slowly as we have just seen. The latter is a more serious mistake (espe- 
cially for the noise-like signal of Fig. 3) if one remains lunited to a single 
opportunity to detect the signal. However, if the signal samples missed 
by one average are included in another and so give another opportunity 
for detection, the loss is reduced but not eliminated, as shown below in 
connection with repeated searches. 

7. DISTRIBUTION OF A FIXED AMOUNT OF SIGNAL ENERGY 

The preceding discussion is closely related to the question of the op- 
timum utilization of a fixed amount of signal energy; assuming that 
VI = m', is it better to have a big pulse of signal occurring in only one 
sample point, or a lower signal power occurring in a proportionately 
greater number of samples? Here the product of S/N and m is held con- 
stant, and one moves along a 45° line in all cases, including Case 3. 
Reference to the curves shows that with a sinusoidal signal one should 
take m = 1, or at least concentrate the signal energy enough to make the 
power ratio S/N very much above unity. With a noise-like signal, the 
same conclusion (m = 1) holds under conditions such that ,S ^ 50 per 
cent, but when better detection is possible a larger value of m may be 
preferable. For example, take the solid curves (a = 10"'^) in Fig. 3 and 
suppose that a one-pulse signal makes S/N = 18 db. The corresponding 
45° hne is tangent to the curve ^ = 99 per cent at about m = 15. Thus 
the maximum detection probability is 99 per cent and is attained by 
taking S/N = (1.5 db, and so distrilniting the signal energj' among 15 
independent samples. Detection with 99 per cent probability by means 
of a single sample would require 20 times as much energy. 
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8. REPEATED SEARCHES 

Repeated searches have two important characteristics: (a) There is no 
carry-over of data from one search to the next. This is not desirable, as 
we shall see, and would expect on theoretical grounds; but it may be un- 
avoidable, (b) They involve repeated opportunities to detect the signal 
(or its source). 

Repeated searches arise non-trivially when the signal recurs peri- 
odically, or can be made to do so by the detecting agency. This assumes 
that it is sufficient to detect the signal at one of its appearances, so that 
it is not necessary to regard each appearance as a separate signal. Exam- 
ples are a signal of long duration but unknown frequency, and the radar 
return to a search radar from an airplane whose position in space is 
unknowTi. Then if one search of frequency or of space does not detect 
the signal, it may be possible to repeat the search one or more times 
before the source of the signal disappears. 

An equivalent of repeated searches arises when the averaging time is 
short enough so that two or more averages fall within the duration of the 
signal. The results below apply to this case and show that a longer aver- 
age (i.e., carry-over of data from one search to the next) is somewhat 
preferable. These results do not apply to the case where over-lapping 
averages give several opportunities to detect the signal, because such 
averages have some data in common; but it has already been shown that 
such overlapping is desirable, other things being equal. 

Suppose now that the signal power is constant and the time consumed 
is proportional to the product of m and the number X of searches. How 
can one find the signal most quickly? If the probability of detection in 
one search is 1/2, the probability that exactly X searches arerecjuired for 
detection is 1/2 , and this also happens to be the probability that the 
signal remains undetected after X searches. Thus one would need to make 
nearly 7 searches before one could conclude with 99 per cent assurance 
that no signal was present. However, if the signal is in fact present, the 
average number of searches required to detect the signal with 99 per 
cent assurance is 

1/2 -H 2/2' + 3/2' + 4/2* + 5/2' + 6/2" + 7/2' = 2 

searches if the superfluous part of the successful search is included, or 

(1/2) -(1/2) + (3/2) ■(1/2'') + ■■■ 

+ (ll/2)(l/2') -h (13/2)(l/2'') = 3/2 

searches if the search is terminated the moment the signal is detected. 
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The latter result is the less favorable for repeated searching, since it is 
3 times the result Q-i) obtained with 99 per cent detection in a single 
search (which nu the average could perhaps be terminated, due to detec- 
tion of tlie signal, when it was half completed). 

The alternative way of increasing /3 from 50 per cent to 99 per cent is 
to increase the vahie of m l^y a factor lying between 2.3 and 5 for Figs. 
1 and 3, while the fading sinusoid of Figure 2 requires a factor of the 
order of 1,000. Comparing these with the factors 2 (or 3) and 7 obtained 
previously gives the following conclusions, which have been confirmed 
by considering some other values of ,3: 

A. With a fading sinusoidal signal, repeated searching is extremely 
advantageous, provided it is true as assumed that independeiit samples 
of the signal are olitainable from search to search but not within a search. 

B. Repeated searching may have a small advantage in Cases 1 and 3 
(the .steady sinusoid and the noise-like signal) provided (1) each search 
has ^ 50 per cent, and (2) the criterion is the average time required to 
detect the signal when a signal is present, and one is not concerned with 
the (increased) time required to conclude that no signal is present (which 
of course is also tlie time required for the detection of some of the signals) . 

C. Repeated searching is somewhat disadvantageous in other cases, 
as one would expect; e.g., in Cases I and 3, if a fixed amount of time is 
available, the grcatc.'it probability of detection is achieved by using all 
of the time for a single search, rather than dividing it among several less 
sensitive searches. 

Mathematical Appendix 

9. PUKE NOISE (and NOISE-LIKE SIGNAL = CASE 3) 

If narrow-band Gaussian noise is applied to a square-law rectifier, the 
value of the output at any instant has a Rayleigh or exponential distribu- 
tion, a.s is well known. The average of in such values, taken far enough 
apart to be virtually independent has a chi-square (x') distribution with 
2m degrees of freedom. The standard form of the distribution used in 
tables choo.ses the units so that the mean of tiie distribution is 2m, 
whereas we want the mean to equal the noise power .V. The exact value 
of k can therefore be found by means of the relation 

Pr{NxL/2m > (/; + 1).V) = a (9a) 

or 

Pr(xL > 2m{k -\- 1)) = a 
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where a is the expected ratio of false detections to total number of deci- 
sions, when no signal is actually present. 

The usual short tables of x^ (e.g., that in Fisher and Yates' Statistical 
Tables or that of Hartley and Pearson in Biometrika 37, p. 313) are useful 
but not entirely adequate for the needs of the problem. The most ex- 
tensive table is that of K. Pearson,'^ which goes to m = 50. In terms of 
the function I tabulated by Pearson, 

PrixL > A) ^ I - 7(A/2vV, m - 1) (9b) 

For m > 50 it is sufficient to use the expansion^ 

xL = 2m + 2um"' + H(ir - 1) + Hsi^' - Tw)™""' - ■ - ■ (9c) 

Here u is the standard normal'" deviate. Thus if «<, is defined by 

a - Prill > Ua) - [ e""°^V/H/V'2^ 

one has 

/>■ = lijVm. + (»J - l)/3m + ■ - ■ (9d) 

If a noise-like signal is present, this is mathematically the same as an 
increase in the average noise power from A'^ to A'^ + S, the critical power 
level remaining at (k + 1) A'". The probability of exceeding the critical 
level is now the probability /3 of a true detection. Thus 

^ Pr[(M + S)xl..j2m > (k + l)iV] 

(9e) 
= Prlxi., > 2m(k + 1)/(1 + S/N}] 

Writing xlU^) f"'" the number that is exceeded by the variable xlm with 
probability ;3, one gets from (9a) and (9e) 

1 + S/N = xL(a)/xL(0) (9f) 

For large m (and only in that case), (9c) then gives 

^A^ - <■"• ' "') [tI + ''^] ^°^' 

8 K. Pearaon, Tiibles of the Incomplete Gamma-Function, Biometrika Office, 
London, 1934. 

" Thr author firai discovered this formula in T. Lewis, Biometrika 40, p. 424, 
1953; hut S. (). Itii'e liaa ])ointed out that G. A. Campbell puhlisheii it as early as 
1923 in ihe B. S.T.J., 2, page 95, in connection with Poiaaon distribution. Other 
references and inversion formulas are given by John Riordan. Aim, Math. Stat., 
20, |). 417, 1949. 

'" "Noi'mal" is a syTinnym for "Gaussian." However a new application of the 
distribution is involved here, and so there is no disadvantage in making the con- 
ventional change in terminology. 



SIGNAL- DETECTION STUDIES, WITH APPLICATIONS 421 

where the standard normal deviate Up is defined bj' j3 = Pr{u > u^). 
It is negative when /3 > 50 per cent. 

Wherever it occm-s in e(iuations, S/N naturally means the ratio of 
*S to N, and not the value in db, which is 10 logio S/N. 

10. NOISE PLUS STEADY SINUSOID (CASE l) 

When a pure sinusoidal signal of constant amphtude is added to the 
noise, the distribution of the rectifier output has what is called a non- 
centi'al chi-square distribution, which has been little tabulated. For- 
tunately the normal distribution gives a fair approximation in this case 
(with the probable exception of .small values of /3, which are of little 
interest anyway). More accuracy could be obtained at tlie (^ost of addi- 
tional labor. 

Before rectification, the signal plus noise can be represented, as re- 
marked in Section 3, by the oxpres.sion 

V2^ cos iSlt -\- f) -^ ui(t) cos (Ul + <p) -\- ih(t) sin (Ut -j- ^) (10a) 

where the two Gaussian noise variables ?ii(0 and n^il) are independent 
and have zero means and a common variance .V. After rectification and 
smoothing, half the square of the envelope is obtained, namely 

[{V2S + 7h{t)f + n,(ty-]/2 

Its mean value is A^ -|- S, and its variance is the sum of the variances 
of the terms in the cxpatKied form, namely -|- 2-¥.S' + N'/2 -\- N^/2 
or 2^^.^ + A'^'. The a^■erage of m such independent variables has the 
same mean N -\- S but the variance N(N -\- 2S)/m. 

The critical value (/>: -|- I )y of the rectifier output is reduced to stand- 
ard units by subtracting the mean output N -f- S and dividing by the 
square root of the variance, giving 



u, = {k - S/N) ^- 



m 



+ 2S/N 
After 1(0 is found from 

e""''- dii/V2Tr 

by using a table of the normal distribution, one can solve the preceding 
" P. B. Patnaik, Biomctrika 36, p. 202, 1949. 
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equation for S/N, giving 



— =t /■ -I- ^ _ "i. 



,,^2-11/2 



1 + 2/.' + — (10b) 



A' m \/m L '" 

This is then the signal-to-noise ratio giving the probability /3 of detec- 
tion. 

By using {9d) and taking 1 + Ua/s/m as an approximate value of the 
radical, one obtains from (10b) 

S Ua — U0 Uffiuff — Uo) + {uj — l)/3 

-Tr — ■""" / + ' ' ~ ■ (lOc) 



This result ditt'ers most (a little over 1 dh) from the curves of Figure 1 
when m = 1 and ^ = 0.01, but (10b) itself is not very accurate in that 
case. 

11. NOISE PLUS FADING SINUSOID (CASE 2) 

In this case the signal plus noise has the form 

[s + n{i)\ cos ffl + [s' + n'(/)] sin ^i (11a) 

where n'{t) is not a derivative, and the components s and s' of the signal 
amplitude are essentially (constant dining the period that is averaged 
over, although like n and «' they are Gaussian variables of mean zero. 
Detection is a('<H)mplished by means of the expression 

/i = ~ [E (s + n,)= + i: (s' + 7^0'] (lib) 

where the n, and n' are (independent) values of n{i) and n'iC) at succes- 
sive sampling points. . , 
Now (lib) can be written 

/I V 1 /I ^^ ^^^""^ 

m \m / m \m 

as in the analysis of varianc^e in statistics. The sum of two squares in the 
first line of (lie) is then distributed as (,S' + N /m)x~i \ the second line is 
distributed as x'i>«--i-N fm; and these portions are independent of one 
another, because they correspond to the mean and the variance respec- 
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tively of the sample of Ui (or nl), and the sample mean and variance are 
known to be independent in the Gaussian case. Here the signal power S 
is the variance of each of s and s', and N is the variance of each of the 
Ui and Tii . 

For detection R must exceed iV(l + k). Hence if S/N is denoted by r, 
one has 

/3 - Pr[{l + mr)x2 + X2,.-2 > 2m(l + fc)] (lid) 

Since (1 + mr)yi. has the c.d.f. 1 - g-'/^ti+mr) ^^^^ ^2^_^ ^^^ ^^^ density 
function 

e-'^-r"--/2'""'r(7K - 1), 

/3 is obtained by convolution as 

= Pr[,L-, > .1 + c-"-*"" (r^)"" p{xL-= (He) 

mr2 \ 



1 + 7ttr_ 



where z = 2m(l + fc). 

An excellent approximation is obtained by replacing the variable 
X2m--i by its mean value 2m — 2; this is reasonable, since the ratio of the 
variances of xlm-2 and (1 + mr)xl is (m - 1)/(1 + m S/Nf, which is 
very small throughout the interesting area (;3 ^ 50 per cent), (lid) then 
gives 

^ = exp [-(1 + km)/(l + m S/N)] (llf) 

This result will be generalized in (13k) below. Using (9d) then gives 

N \/m m 



to a little lower order of accuracy when m is small, and still with ^ ^ 
oO per cent. 

Before the foregoing results were obtained, the curves of Fig. 2 had 
already been calculated'' on IBM equipment by the rather tedious pro(!- 
ess of integrating the results for Case 1 with respect to the random signal 

12 By Mrs. L. R. Lee, at the request of the author. 
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strength. This gives 

/3 = f ^[{xS/N - /v) Vm/il + 2xS/N)]p{x) dx (llh) 
Jo 

for Case 2, where 

p(x) = e~^ 
and 



J—!B 



If the fading is due to interference between two sinusoidal signals of 
powers Si and 82(^1 -\- S2 = S) and very shghtly different frequencies, 
it can be shown that the appropriate form ioTp{x) is I/ts/A^ — (1 —x)^ 
for 1 — A < X < I -\- A, and zero elsewhere, where A = 2\/SiS2/ 
{Si + S2). Here x can approach zero only in the special case Si = S2 . 
Since one or both of Si and S2 , and hence A, is likely to be a random 
variable, one apparently cannot say a priori that any particular dis- 
tribution p(x) is the appropriate one in this case. 

12. COMPARISON OF 12 CASES 

The three principal cases defined in Section 2 and analyzed in the last 
three sections may be expanded to 12 by considering dc signals as well 
as ac, and considering also a second method of detection. The original 3 
cases will be labeled "ac envelope." {More precisely, half of its square is 
the quantity averaged.) If the envelope is not isolated but instantaneous 
squared values are sampled, the situation is "ac instantaneous." A pre- 
cise analysis of these latter cases would apparently be difficult. As indi- 
cated, quadratic rectification is assumed for all 6 of the ac cases. On the 
other hand, for the 6 dc cases, distinguished as rectified and unrectified, 
it is the instantaneous sampling that is assumed throughout. 

The reduction of the rectified dc cases to the standard ac envelope 
cases has been indicated at the end of Section 3, and will be demonstrated 
at the beginning of the following section. The unrectified dc cases, which 
represent the better way to detect a steady or fading dc signal, involve 
nothing but the simple Gaussian distributions specified in Table I. If the 
number of samples averaged is denoted by 2m, one easily finds the the- 
oretically exact relations 

S/N = («„ - Uffy-/2m. (12a) 

S/N = (uU/uln - l)/2m (12b) 

S/N = uli-,Juli2 - 1 (12c) 
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Table I — Variables to be Averaged 
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DC Unteclified 


DC Rectified 




VS + n 

s -\- It 


S + 2n VS + n^ 


FadinK \ 


s* 4- 2ns + 71^ 


Noise-IikpJ 






AC Envelope 




S + n V2S + (n^ + n'*)/2 


Fading 1 


[(s + 7i)s + (s' + n')2]/2 


Noiac-likej 






AC Instantaneous 




[{\/2S + n) cos ^ + n' aiii f]' 




[{s + n) cos V + (s' + n'} sin v]^ 




Ditto or s- + 2ks + n- 









for the Htcady, fading, and noise-like uiirectified dc (or low-pass) signals. 
As usual, ^lp is defined by 



J It ^ 



Tn (12a) it is assumed that the steady dc signal of magnitude \/S is 
of known sign. Otherwise it would be necessary, as with fading and 
noise-like signals, to be prepared to detect both positive and negative 
(1(^ signals, and quantities like »„/•> enter in place of iia via the relation 









As /3 approaches unity, »^/2 approaches zero and S/N rapidly approaches 
infinity for the fading and the noise-like signal. In the latter case (12c), 
averaging has no effect (m does not appear), because the unrectified signal 
averages to zero as fast as the noise does. In fact, with instantaneous 
sampling ol' a noi.se-like signal, there is no essential difference between 
the lowpass ("dc") and narrow-band (ae) ca.ses. 

If n, n', s, s' are independent Gaussian variables with zero means and 
variancei3 .V, .V, .S', S respectively, and <p is uniforaily distributed between 
and 2Tr, the varial)les that are averaged in the detection process have 
the forms given in Table I in the various cases, when a signal is present 
(if not, ptit s, s', and *S' equal to zero). 

Table II gives the variances of the variables of Table I for the cases 
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Table II — -Variances 





DC Unrectified 


DC Rectified 


Steady 


N 

N + S 


2A'2 + 4A'S 

2;V' + 4A'S + 2S= 








AC Envelope 


AC Id Stan tan eo us 


Steady 


N^ + 2NS 

N^ + 2NS + S^ 


2A^ + 4A^S + HS' 




2m + 4AS + 2S' 







of a steady or a noise-like signal. The means are -s/S and zero, respec- 
tively, for the dc unrectified variables, while all the others have the 
power A^ -1- *S as their mean. 

Table III gives the data for the fading signal. The reducible variance 
and the m.ean are calrulated under the condition that s and s' are fixed; 
the irreducible variance is then the variance of the resulting mean when 
s and s' do vary. The distinction between the two variances is that by 
averaging, the first is reduced in the usual way (divided by the number 
of samples), while the second retains its full value. The variance ah'cady 
given for the steady signal can be derived from the reducible variances 
above by replacing s"- and .5'^ by S. The variances already given for the 
noise-like signal are equal to the irreducible variance plus the expected 
value of the reducible variance. 

The steady ac instantaneous case wiU serve to illustrate the calculation 
of the variance. If the rectifier output is written in the form 

S + ny/2S + ("-' + «")/2 + {n'^2S + nn') sin 2ip 

+ [8 + ny/2S + (n' - n'')/2] cos 2ip 

it may be verified that the various terms are uncorrelated with one 
another, so that their individual variances may be added. Also E sin 
2ip = E cos 2^ = Q,E sin' 2^ = E cos' 2p = ]4, En = En'^ = •iN\ 

Table III — Fading Signals 



DC unrectified . . . . 

DC rectified 

AC envelope 

AC inslanlnneouH 



Reducible Variance 



A 

2A2 + \Ss^ 
A'= + A^(s= + s'=) 
2A2 + 2N{s-- + s' 
(s^ + ,s'=)VS 



+ 



Mean 



S 

A + s= 

N + (s^ + &'^)/2 

N + (s^ + s"}/2 



Irreducible 
Variance 



S 
25= 
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var n" = var n'' = 2N~. These last relations are not obvious, but are a 
spe(!ial case (i = u) of the relation cited below just prior to (15e). The 
variance is now obtained as 

+ 2NS + m-fA + i-^/!.'(2'S'«" + nSi'-) 

+ liEiS' + 2Sn- + («* - 2n',i'' + h.")/4] 

= 2N- + iNS + SV2 

The variances tabulated indicate the relative merit of the various cases. 
If m is significantly greater than unity, the anomalous case of an unrecti- 
fied noise-like signal represented by {12c) gives the poorest detection; 
next come the fading signals with their irreducible variances. The steady 
dc unrectifiod signal with S/N proportional to ?«"' (by 12a) is the easiest 
to detect. The steady signals are in all cases more easily detected than 
the noi.se-like at the higher signal strengths. However, instantaneous 
sampling of a steady ac signal loses some of this advantage; a term 
.S'"/2 appears, in addition to the expected doubling of the variance of a 
single sample. 

13. DETECTION OF AN ARBITRARY GAUSSIAN SIGNAL 

General formulas will now be derived which include Cases 1, 2, and 3 
and also give approximations to intermediate cases. It will be more con- 
venient to deal with the Gaussian sample vahies s,- + iii of the signal 
plus noise in the dc or lowpass case, and 2m of them will be taken so that 
the results obtained will have the same form as those already given for 
the ac or narrow-band case. Detection is then accomplished by means of 
the variable 

/? = E (?.■ + nd'^nm = Z (S'-' + 2s,H,- -f nr)/2m (13a) 

It iw assumed that the Ui are independent of one another and of the st , 
while the s, may be constant or mutually correlated. Also Em = and 
Eni = N,ii constant. 

An orthogonal transformation (rotation in 2m -dimensional space) can 
be used to show that (13a) has the same distribution as 

X; (h -f n/r/2m Cl3b) 

1 

fi; (/' V2 + n,-"r + E nr~\ /2m gsc) 

L t "1+1 J / 



or 
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where }i = ^i'" sl/2m, and the «/ ov n" are new noise variables with 
exactly the same properties as the original n, . Evidently }i is so defined 
as to leave unchanged the terms independent of the noise variables, while 
the orthogonal transfoiination by definition makes ^ »,' = X] ^''" ~ 
^ «/'-. Thus it is only necessary to choose the transformation so that 
the oi'iginal linear terms zj\' soxifm go into h ^i"' rt//m or \/2/i yj\ 
n'' Im. This is always possible since all three expressions have the same 
norm (square root of sum of squares of coefficients), namely /) ■\/2/m. 
The forms fl3b) and (13c) are appi'opriate to the instantaneous sam- 
pling of the square of a dc signal plus noise, and the sampling of the 
square of the envelope of an ac signal plus narrow-band noise, respec- 
tively, the latter being the standard case. Thus the equivalence : f the 
two cases is established. It is only necessary to observe that the number 
of samples taken is 2m in (13b) but only m in (13o). The noise powers 
are Eui and 

E{ni cos <p -\- ■n„,+i sin ipf = E{n^ + nl^+i)/2 = Enl. 

The signal powers are h~ and E-2h' cosV = h'. Another consequence of 
(13b) or (13c) is that when the distribution of h has a known form, the 
distribution of R could be obtained from the results for Case 1 by inte- 
grating over h, as stated at the end of Section 11. 

The mean and the variance of the general form (13a) will now be (cal- 
culated. It is assumed that Esi = and Esi = S for the first 2m' values 
of i(m' ^ m), while s,- = for the other 2(m — m') values of i. Then one 
has ER = N -\- m'S/m. If i and j are any two distinct integers, the five 
variables s;", s,7i, , Sjiij , ?t,', w/ are all uncorrelated (though not all inde- 
pendent), and so one has 

4m^ var R = var (^ s,') + 4 ^ var (s.ti,) + 2m var n,- 

Since var (s,-??,-) — NS or and var n," = 2N , this gives 

var R = var ft' + 2m'NS/m + N''/m (13d) 

with li ^ X-i "' Si'/2m. In Cases 1, 2, and 3, var h' = 0, (m'S/m)', and 
m'S^/nt^ respectively. (In Case 2, m' of the s, have one identical value 
and m' have another identical value, independent of the first.) In general 

varA=- 'y! {2m' -\i\)^p\i)/2m' (13e) 

-2m '+1 

where ^{i) = EsjSi+j for all j for which sySj+j ?^ 0. This is the discrete 
analogue of the integral appearing in {15k) below. It is convenient to 
define a number m" (which need not be an integer) such that var h = 
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{m'S/mf/m". Then putting S' = m'^fm- gives 

ER = N + S', var R = S"/m" + {2NS' + N')/m. (13f) 

The mean and variance of R are identical with those of [S''^/m" + 
(2NS' + A''')/m]/2(A'' + S') times a chi-s(iuare variable with 

2m = 2(iV + S'f/[S'ym" + (2NS' + N')/m] 

degrees of freedom. So one has approximately 

^ = PriR > {k + 1)A^) 

= Pr{x\,n > 2(k + l)NiN + S')/[S"/m" + (2NS' + N')/7n]] (13g) 



^ Pr{w > (/cA^ - S')/VSym" + (2iV^' + iV2)/m} 

The last line can be used to verify that for fixed m, the optimum value 
of m' is m, and for fixed m', the optimum value of m is m'. Defining u^ 
by Pr{H > Uff) = /3 and solving for S/N = mS'/m'N gives 

S/N 

^ mk + «/ - lis VC^k + l)m + k-'m'/m" - u^^m/m" - 1) ^^^^'^ 

m'(l - V/^'i") 

The approximation breaks down if ;// ^ vi" . 

It can be shown that by replacing the symbols m', m", and S in the 
above formulas by m'/2, ?n"/2, and 25, one obtains the results for the 
narrow-band case in which the signal is a noise-modulated carrier 5(0 
cos ^t, while the noise as usual has the form n(t) cos Ut + n'(t) sin Ut. 

In Cases 1, 2, and 3, m" = =* , 1, and m' respectively; also, m' has 
been assumed equal to m. In the dc or lowpass case, m" could be as small 
as }yi- One has m ^ m' always, and m' ^ m" when the signal is Gaussian 
(i.e., contains no steady sinusoidal or steady de component). 

When m" is very small, (13g) and (13h) are of low accuracy, and it is 
much better to use (lie) or (llf), or the following generalization of 
them. The derivation proceeds as if m'/m" were an integer, although this 
is probably not a necessary condition for the usefulness of the results. 
The averaged rectifier output is represented by 

2m" m'lm-' 2m— 2m' 

2mR = E Z (s. + f^ij)"' + E «.■' (13i) 

where the n.j are 2m' independent Gaussian noise variables accompany- 
ing the signal variables s, (which have only 2m" independent values), 
and the n.- are 2m — 2m' additional noise variables that are not accom- 
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pauied by a signal. Of course, the signal variables would not in reality 
fall into independent sets of identical values, so that an approximation 
enters here even if m' /m" is an integer. 
(13i) may be written as 

2mR = {m/m") Z (s,- + n,+)^ + E ""Z (n,-; - ",+)=' 

1 
where 

m' Im' ' 

ni+ ^ im" /m) ^ niy 

»Sr = var Si 

N = var Uij = var n^ 

and the two x^ variables are independent. If the ratio m"{m — m")/ 
(m" + m'S/Nf of the variances of the latter (including their multipliers) 
is small, one may replace xLi-2m" by its mean value 2m — 2m" and ob- 
tain 

/3 - Fr\R > (1 + h)N\ 

(13k) 
= Pr\x2,.- > 2(m" + mk)/a + m'5/m"iV)] 

14. COrNTING SAMPLES ABOVE A THRESHOLD 

It is sometimes suggested that instead of averaging the m samples, the 
number of such samples exceeding some threshold might be counted and 
used as the detection criterion. This is equivalent to replacing the 
average of the m samples by one of their order statistics, such as the 
median. 

It is of interest to ask which order statistic is best to use, and how it 
compares in efficiency with the average. M. Schwartz (in the dissertation 
cited previously) made numerical calculations for the case of a steady 
sinusoid and m ^ 49, and concluded that the method of coincidences, as 
he called it, required S/N to be about 1.4 db above that which sufficed 
for equal performance using averages. For the larger values of 7n there 
appeared to be a small advantage in requiring less than half the samples 
to exceed the (suitably chosen) threshold. These results are confirmed 
by the following asymptotic analysis. 

In the absence of a signal, a single sample of half the square of the 
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envelope has an exponential distribution e~^'^' dx/N . The same (witli 
increased power A'^) is true in the presence of a noise-hke signal, and ap- 
proximately so for a sinusoidal signal of low intensity'. Since m, is assumed 
to be fairly large, low-intensity signals are the interesting ones. In both 
of these cases detection can be based on an estimate of A'^, denoted by A^. 
In the present method N is determined from p = e"'^''', where p is 
the proportion of samples observed to exceed the threshold K. The 
standard deviation Op of p is well-known to be '\/-p{\ — p)/m, where 
p = e"'"''^' = the "true" or expected value of p. For large m the sampling 
fluctuations are small and the standard deviation a'y of N is approxi- 
mately equal to ffp times dN/dp or o-p -^ e~^'''^ -K/N'^ or 

t; = N{\ - pf'/impf Cn (1/p) (14a) 

for counting samples as compared with 

tr,Y = Nls/m 

when the average is used. So the efficiency of the counting procedure (ex- 
pressed in terms of the (inverse) number of samples required for ecjuiva- 
lent reliability) is 

<J^^I^'^ = (Cn l/pfp/il - p) (14b) 

This expression haw its maximum value of 64.7 % when p = e~ ~'' 
— 0.203. The median (p = }^) has an efficiency of only 48.0%. For large 
m, the required ^/N varies as m^'''' and so the minimum loss due to 
counting is 10 logm 0.G47""" = 1.0 db. 

In the case of the steady unrectified de signal, the detection problem is 
equivalent to estimating the mean ^ of a Gaussian distribution 

The estimate a* of m '« determined from 

and the same relation Iiolds between the true values p and m- Then 
dp/dfi = <p\(K — fi)/<7\/(r and 

<t', = aV^m - ^mM^)V2i>'i (14c) 

where ^ ^ (K — n)/c and 2m is the number of samples. The variance 
a-p of the mean is (r/-\/2m, so the efficiency of the countng procedure is 

<T%/<j'\ - A^)Mm - Hm . (i4d) 



R 
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The following are some values of this expression : 

I 0.5 1 2 

Efficiency 63.7% 58.0% 43.9% 13.1% 

Thus the highest efficiency of 63.7% is attained when ^ = or the 
threshold K equals the mean m- This corresponds to using the median 
as the statistic on which detection is based. This maximum efficiency is 
very nearly the same as that obtained in the preceding case. However, 
in the present case S/N varies as m~^ by (12a), so that the equivalent 
loss in signal strength is not 1.0 but 10 logio 1/0.637 = 2.0 db. 

15. AVERAGING BY CONTINUOUS INTEGRATION 

In practice, m place of the discrete sums of squares such as (lib) and 
(13a) one may have integrals such as 

c = [ Z{t) dt/T and (15a) 

Jo 

R^ = [" Zit)e"Ut/T (15b) 

where Z{t) is the variable to be averaged (usually a rectifier output), 
and the subscripts U and E refer to uniform and exponential weighting 
respectively. The purpose of this section is to calculate the mean /j. and 
variance <j^ of each of these expressions for various cases. It will then 
be shown that for a flat spectrum and T ^ t» , /x and a are the same as 
those already given for the discrete averages of samples. The results 
are closely related to those given by Rice. 

It will suffice to consider steady signals. If the signal is absent, put 
S = 0. If the signal is fading, S is a random variable. If the signal is 
noise-hke (with the same spectrum as the noise), put S = and replace 
N hy N -{- S. The four combinations of ac and dc signals with two 
methods of detection (see Section 12) will be considered separately. 

The exceptional case of an unrectificd dc signal may be disposed of 
first. Then Z{t) = -y/S + n(t) and Ru and Re both have Gaussian dis- 
tributions with mean \/S. The variance of Ru is 

E(fn{t)dt/Tj 

Writing the square as a double integral and taking the expectation under 

13 S Rice, B.S.T.J., 24, pp. 46-156, 1945, Eqos. 3.9-8 and 3.9-28. Also J. 
Aeous. Soc. of Amor., 14, pp. 216-227, 1943. 



(15c) 
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the integral sign gives 

varRu = E f f n{t)n{u) dt du/T^ 

JO Jo 

= \ I ^{t - u) dtdu/T' = 2 f (T - v)yP(v)dv/T' 

Jo Jq Jo 

where ^(y) = En{t)n{t -f- y), and ^(0) = N. Similarly 

var R^ = r r e-"+"'^^^(i - u) dt du/T' 

JQ Jo 

(lod) 

= r e"'''yp{v) dv/T 
Jo 

In the remaining three cases, Ru and Re always have the power 
N -\- S as their mean. Their distributions are not known exactly but they 
might be assumed to be distributed approximately like (a'/'2fx)x%'^/o^ 
where n is the mean ,V + S and a' is the appropriate variance given 
below. A probably more convenient procedure is to use the fi = N and 
a = do' (see 15k and foi" the noise alone to determine an equivalent 
value N^/ao^ for m, and then use Figs. 1-3. 

Consider next the rectified dc signal, so that 

Z(t) = S -{■ 2VSn(t) -h n\t) 
The variance of i^t^ is E[Ru — S — N\' or 

[n\t) - N] dt/T + 2^/S f n{l) dt/Tj , 

The cross-product has zero expectation. Expressing the squares as 
double integrals gives 



E I I {{n\t) - N][n\u) - N] + ^n{i)n{u)) dtdu/T\ 
Jo Jo 



.T pT 

lo Jo 

We now take the expectation under the integral sign. For 

En\t)n\u) = rl^\0) -f 2f-(t - u) 

see M. G. Kendall, The Advanced Theory of Statistics, Volume I, Sec- 
tion 3.28, equation 

M22 = (1 + 2p")(TrO-2' 



2 

(15e) 
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This gives 

var Ru = f f Wi.t - «) + 4S\t(/ - u)] dt du/T 

Jo Jo 

= 4 f (T - iWiv) + 2.SV(y)]rfy/?" 

h 
A similar treatment of Rb gives 

var Re-2 r c-'-^-i") + ^S^i^)] dv/T. (15f) 

Jo 

The third case is that of a sinusoidal signal with instantaneous sam- 
pling, for which 

Z(() = 2.S cos' (m -\- ^) -\- 2V2Sn{t) cos {Ql + -p) + n(t) 

where ip is uniformly distributed in (0, 2t). The variance of Ru is now 
given l)y 

E ( r \n-{t) - N\ dt/r + 2 J ^2S cos iSlt + <p)n{t) dt/T 

T \ - 

+ J S[2 cos' {m + ¥') - 1] dt/T) 

= E f f [n\t) - N][n'{u) - N] dtdu/T' 

Jo Jo 
= ESS I cos (Qt + <p) cos (fiu + ¥')n(On(M) rf' ^m/T' 

Jo JO 

+ E-S- / / cos (20/ + 2^) cos {2ilii + 2<p) dtdu/T^ 

Jo Jo 

To find E cos (S2/. + v) cos (Sitt + ^), expand the cosines, note that 
E cos' ip = E sin' i^ = 3-^ and E cos ^ sin <p = 0, and combine the re- 
sulting terms. This gives 

var Rv = I I (2i/''(/. - w) + 4^>^(( - «) cos fi(i - u) 
Jo Jo 

+ yiS"- cos 2fi(^ - »)) dt du/T^ (15g) 

= 4 ['' (7' - iWiv) + 2S\^(y) cos M dv/T" + (.SV2f '«') sii>' ^'^'■ 
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A similar ti'eatment of R^ gives 
YJir Hn = 

Jo 
of which the last term is the evaluation of 

I" r r ,-o+..>'r p^g 2fi(/ - n) dl du/T^ 
2 Jo Jo 

It remains to consider the narrow-band case, with filtering after 
rec.tific^ution to give half the sciuare of the envelope. As in Sections 3 and 
10, the final output has the form 

Z(t) - S -f V2Em(t) + [n,'(t) -f n,'(t)\/2 

The variance of Ru is then 

E Q f^ Wit) -I- nlU) - 2N] df/T + V2S _^' n,(0 dt/T 

The usual method of evaluation gives 

vavRu = 2 /" (T - y)[\t^aO + ^?00 + 25i/'oW](/V?'' (151) 
Jo 

var Re - r e-"''[\('2(y) + ^f^Kv) + 2£I\t„(y)l dc/T (15]) 

Jo 

where 

Mv) = En,{t)nx{t + v) = Eri^{t)n',{l + v) 

arid 

^P^iv) - En,(t)n,(t + y) - - S«.,(i -K !.)w-XO. 

Then 7' — * ^ , the ratio of the variances of Re and Ru approaches 
one-half in all cases, so it will suffice to consider the latter. The spec- 
trum of the noise will be assumed to be flat, of width ui radians per sec- 
ond. Then in (loc) and (15o) one has j}/(v) = N sin tA)f'/(j;% and so the 
variance of Ri- is asymptotically e(|ual to 

A'" sin (jiv 



2_ r 

T h 



dv 



and 



4 r VN^ sin^ uv . 2NS sin wf" 

rio L 



(uv) ■ COV 

respectively. 



dv 
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Putting \p(v) = {2N/o}v) sin (aiy/2) cos ilv in (15g) gives 

r r^WW2 ^ 2NS sin ../2 l ^^^. ^^ ^^ 
io L (wu/2)^ coy/2 J 



4 



Putting 

^i(v) = 0, ^o(y) = (2NM sin (0)1-/2) 

in (loi) gives 

N^ sin' wy/2 , 2NS sin ^2 1 ^^ 



!/:[ 



{wy/2)2 a.v/2 

The first integral has the ^^ahie irN/oiT and the last three all have the 
value (2Tr/uT)(N" + 2NS). Comparing these with the variances of 
single samples given for steady signals in Table II (Section 12), and writ- 
ing co/27r = W cps we see that Ru is asymptotically equivalent to 2WT 
independent samples in the two dc cases, and WT in the ac envelope 
case. The number is something above 2WT for instantaneous samples 
of ac. These results agree with those arrived at in Section 3 and 13. 
With the exception of the unrectified dc signal, the differences are seen 
to lie in the efficacy of an isolated sample, rather than in the long-term 
rate of transport of information. 

When the signal is absent, (15e) to (15h) reduce to the results of Rice 
cited above: 



and 



var R^ =^ A r (T - v)^\v) dv/T' (15k) 

Jo 

varR. = 2 H e-"'4''{v) dv/T (150 

Jo 



The same is nearly true for (15i) and (15]) also, smce by (3c), Mv) + 
^l(v) is the square of the envelope of ^''(y) in the narrow-band (ac) 
case. 

*6. OPTIMUM PROCEDURES AND THE BASIC ASSUMPTIONS 

The rigorous determination of the optimum detection procedure is a 
deep problem with more or less complicated answers depending on the 
spectra and probably involving both discrete sampling and continuous 
integration, or even differentiation." '^ However, the solution of the prob- 

i^U. Grenander, Stochastic Processes and Statistical Inference, Arkiv for 
Matematik, 1, p. 195, 1950, Sections 4.11 and 5.4. _ . ^r ■ 

15 E Reich and P. Swerling, The Detection of a Sine Wave in Gaussian Noiae. 
J. Appi.Phvs.,24. p, 289, 1953. ^ ^^ . ^ 

'fl D. Slepian, Esiimation of Signal ParameterB in the Presence of Noise. Irans. 
IRE Professional Group on Information Theory, p. 68, March, 1954. 
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lem is known as soon as one restricts oneself to independent samples 
of the signal-plus-noise. Then square-law detection and averaging is 
the rigorously optimal procedure for detecting a noise-like signal, and it 
is virtually optimal for a steady sinusoid. The rigorous optimum in the 
latter case is well-known and depends on the assumed signal power S; 
if V is the amplitude of the envelope (output of a linear rectifier), then 
a non-linear rectifier or other device is to be used to convert v to 
log Jq{v\/2S/N), and the values of the latter are averaged. Iq{x) is 
the Bessel function JoCi; -y/—!). This corresponds very nearly to 
square-law rectification when S/N is small, and linear rectification 
when S/N is large. Since square-law is little different from linear rectifi- 
cation, as noted in Section 1, it is also little different from the optimal. 
For a steady dc signal, the optimal procedure uses the average of the 
algebraic values of the samples (without any rectification); the per- 
formance is given by (12a). 



